Aircraft dialog method including auxiliary object marker

ABSTRACT

A dialog method for dialog between an operator of an aircraft and at least one system of the aircraft including the steps of displaying on a display at least one window including a plurality of responsive objects respectively associated with one of multiple functions of the at least one system of the aircraft, moving a cursor on the display so as to designate a responsive object such that when the cursor is on the responsive object, a main object marker appears and designates the responsive object, and discretely displacing an auxiliary object marker on the display, responsive object by responsive object, so as to designate a responsive object without affecting control of the main object marker.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a divisional application of published U.S. application Ser. No. 10/062,671, filed Feb. 5, 2002, Now U.S. Pat. No. 7,113,167 which claims priority under 35 U.S.C. § 119 to French Patent Application 01 02566, filed on Feb. 26, 2001, the entire disclosure of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION Field of the Invention

This invention concerns a device for dialog between at least one operator of an aircraft and at least one system of the aircraft. This system includes the functions which are liable to be initiated by the dialog device, under the action of the operator, so that they can be executed.

In the context of this invention:

“execution of a function” means, in particular:

implementing a command to an element (engine, lighting, etc.) of the aircraft, or a particular action;

data entry;

access to pages of information on a screen; and/or

access to additional information or actions without changing a page;

the system, e.g., a flight management device, may include “procedures” for navigation, communication, monitoring and/or flight management of the aircraft, and “procedures” for managing elements such as engines or lighting, or alarms of the aircraft.

The dialog is implemented via at least one window which is displayed on at least one screen, in general a screen on the flight deck, and which is of an “interactive” type. In the context of this invention, “interactive window” means a window which includes responsive objects (points, ranges, alphanumeric values, lists, menus, etc.) which are associated respectively with particular functions of the above-mentioned type, and which respond to the presence of a cursor. The cursor can be displaced by an appropriate device which can be actuated by an operator of the aircraft, in such a way that it can be displaced to a responsive object to designate or mark it. When a responsive object is designated, i.e., when the cursor is displaced to it, the responsive object is marked or highlighted, in particular by a change of appearance such as a change of color or increased brightness. The responsive object is then said to have an “object marker” or “focus.”

Confirmation (using an appropriate controllable device) of a responsive object which has such an object marker initiates the execution of the function which is associated with said responsive object.

DISCUSSION OF THE BACKGROUND

Various dialog devices which are capable of implementing the designation and confirmation of a responsive object of this type are known.

In particular, from Patent FR-2 677 149, a device for reviewing the lateral flight plan of an aerodyne is known. This known device includes a designation device which is fitted with a confirmation element, and which is connected to the processor of the flight management system of the aerodyne in such a way as to obtain, on the screen of this system, as well as the geographical representation of the flight plan which the pilot initially selected:

a responsive field associated with each point of the screen;

dynamic function ranges which are used to compose menus; the function which is assigned to each of these ranges can vary from one menu to another and is indicated on the display corresponding to this range; and

a luminous index, the movements of which on the screen are controlled by the pilot acting on the designation device, in such a way that the index can be displaced to a range or a responsive field;

the function which corresponds to this range is activated, or a point of the area is selected, by the pilot acting on the confirmation element.

Additionally, from Patent FR-2 743 921, a device, which is part of a global control system of an airplane, to aid in aerial navigation of the airplane, is known. This system includes, in particular, a Flight Management System (FMS) and interfaces for dialog with the pilot, including, among other things, information display screens for navigation and piloting, and a display and data entry console of the Multipurpose Control Display Unit (MCDU) type. This MCDU console includes a keyboard which is exclusively intended for data entry, a screen and devices to make it possible to select fields which are displayed on the screen and to activate the selected field to initiate operations which are related to what is displayed. These selection and activation devices make it possible to:

displace a cursor in a menu which is displayed on the screen, to select a field which this menu offers; for instance, the brightness of this field increases when the cursor is displaced to this field; and

to activate a selected field.

Functions which are initiated in this way (designation of the associated responsive object and confirmation) by the dialog device are, in general, functions which were planned in advance and carried out at a particular moment during, before or after the flight.

However, it may happen during a flight (or even before or after the flight) that the crew of an aircraft is obliged, sometimes urgently, to carry out particular actions, i.e., is obliged to initiate execution of particular functions, which cannot be anticipated. This is in general the case when the pilot is alerted by various systems of the aircraft to a change in the operational situation of the aircraft, requiring him or her to deal with it urgently, e.g., dealing with a failure or generating a response to an Air Traffic Control (ATC) message.

Now, at the moment when such a request to deal with something occurs, it is possible that the pilot is in the course of initiating execution of another function, which may be habitual or not, and the cursor has been displaced to the corresponding window for this purpose.

In such a situation, with the dialog devices which are disclosed by the above-mentioned Patents FR-2 677 149 and FR-2-743 921, the pilot has two options:

either he or she interrupts the function which is in the course of execution and displaces the cursor to the window which contains the new function (e.g., an emergency function), to designate and confirm the responsive object which is associated with this new function;

or he or she waits, before initiating the new function, until the function in progress has been fully executed.

Of course, neither of these possibilities is satisfactory.

It should be noted that, in the case of a dialog device such as is described in document U.S. Pat. No. 6,112,141, containing two cursor displacement devices each of which is capable of controlling one cursor, and which are intended for two different operators (e.g., the pilot and copilot of the aircraft), the emergency function can be initiated by the operator who is not controlling the function which is being executed, obviously in the case that this operator is not controlling any function.

The document U.S. Pat. No. 6,112,141 describes a flight deck which contains, in particular, multiple screens, a multi-functional control unit, two keyboards (or voice-operated systems) which are exclusively intended for data entry, and a dialog interface. This dialog interface includes at least two identical cursor control devices, in the form of control balls or spheres, one of which is intended for the pilot and the other for the copilot. These control balls make it possible to displace the corresponding cursors continuously on the screens, to designate responsive objects. Additionally, in the case that two different cursors designate the same responsive object, the command from the cursor which did the designation first has precedence, because no priority is provided between the different operators.

However, in the case that the two operators are both in the course of initiating execution of functions using their dialog devices, or in the case that one of the two is occupied on other tasks, if an emergency function has to be executed, the situation is the same as before, with the same dilemma, i.e., whether to interrupt the function in progress and initiate execution of the emergency function, or to terminate the function in progress before initiating execution of the emergency function.

SUMMARY OF THE INVENTION

This invention concerns a dialog device which is of the type described above, and which makes it possible to overcome the above-mentioned drawbacks. For this purpose, according to the invention, the device for dialog between at least one operator of an aircraft and at least one system of the aircraft, the dialog device including:

at least one screen which is capable of displaying at least two responsive objects on at least two interactive windows, each of said responsive objects being associated with one of multiple functions, the functions being capable of being initiated by the dialog device under the action of the operator so that they are executed; and

at least one cursor control device, which is arranged so that it can be actuated by the operator, and which includes at least:

one actuatable displacement means, which is capable of displacing a cursor on a window, to designate a responsive object by making a main object marker appear; and

one actuatable confirmation means, which is capable of confirming a responsive object which has the main object marker, to initiate execution of the function which is associated with the responsive object,

is notable in that it includes, additionally, auxiliary control means which are arranged in such a way that they can also be actuated by the operator, which are intended to control an auxiliary object marker without affecting control of the main object marker, and which include:

at least one actuatable displacement element, making it possible to cause a discrete displacement of the auxiliary object marker, responsive object by responsive object, on an interactive window; and

at least one actuatable confirmation element, making it possible to confirm a responsive object which has the auxiliary object marker, to initiate execution of the function which is associated with the responsive object.

Thus, when, during execution of a particular function (which has been controlled in the usual way by designating and confirming a responsive object using the cursor control device controlling the cursor), another function, in particular an emergency function, must be executed, the operator (who has access to both of the cursor control device and the auxiliary control means), can initiate execution of this other function using the auxiliary control means, since the auxiliary object marker which is controlled by them does not affect the control which is carried out using the cursor and the main object marker.

Consequently, the second function (e.g., an emergency function) can be executed without having to interrupt the execution in progress of the first function (e.g., a usual function which was planned in advance), the two executions being controlled by the same operator.

Additionally, since the auxiliary object marker is subjected to discrete displacement, it being possible to carry out such a discrete displacement in a precise manner in any situation, in particular while the aircraft is being shaken, execution of an emergency function can, thanks to the invention, be carried out whatever the phase and/or conditions of flight, and in particular when the aircraft is in an area of turbulence.

In a preferred embodiment, the auxiliary control means are fitted in a separate, specific box, which has keys, and the displacement and confirmation elements (to control the auxiliary object marker) are the keys of this specific box.

In another embodiment, the elements for displacement and confirmation of the auxiliary control means (to control the auxiliary object marker) can be the keys of an ordinary keyboard which enables the operator to enter data.

Additionally, in a particular variant, to reduce the space requirement, the cursor control device is not an independent device, but is also formed by some of the keys of the keyboard. Thus, in this case, the (only) keyboard is used simultaneously:

to enter data into the system;

to control the auxiliary object marker; and

to control the cursor (i.e., the main object marker).

To do this, different combinations of keys of the keyboard are simply used to carry out, respectively, the different tasks.

Additionally, to facilitate the designation of responsive objects, in an advantageous embodiment, the responsive objects are arranged in at least one direction which is defined with respect to the interactive window, e.g., vertically or horizontally, and the auxiliary control means include at least one displacement element which corresponds to a direction arrow which makes it possible to displace the auxiliary object marker from one responsive object to another, responsive object after responsive object, following the defined direction in a certain way.

Additionally and advantageously, the cursor control device and the auxiliary control means are formed such that control of the main object marker by the cursor control device has priority over control of the auxiliary object marker by the auxiliary control means when the two markers, main and auxiliary, are on the same interactive window.

In a first embodiment, the cursor control device causes, in the usual way, a continuous displacement of the cursor on the interactive window, whereas, in a second embodiment, the cursor control device causes, also in the usual way, a discrete displacement of the cursor on the interactive window.

Additionally, to provide great flexibility of use and increase the operator's comfort in the execution of his or her tasks, the dialog device according to the invention can include two cursor control devices which are arranged in such a way that they can both be actuated by the operator, one of the cursor control devices causing continuous displacement of the cursor and the other causing discrete displacement of the cursor.

Additionally and advantageously, the cursor control device includes means for displacing the cursor from window to window and, when the dialog device includes at least two screens, a means for displacing the cursor from screen to screen. Preferably, each screen includes multiple fields, and displacement of the cursor from field to field is implemented in such a way that displacement from a first window to a second window is obtained indirectly by displacement of the cursor from the last field of the first window to the first field of the second window.

In a preferred embodiment, the dialog device includes two cursor control devices and two sets of auxiliary control means, one cursor control device and one set of auxiliary control means being intended for the pilot of the aircraft, and the other cursor control device and the other set of auxiliary control means being intended for the copilot of the aircraft.

This invention also concerns an aircraft system as above, which is notable in that it includes the dialog device according to the invention, to allow a dialog with an operator, in particular a pilot, of the aircraft.

BRIEF DESCRIPTION OF THE DRAWINGS

A more complete appreciation of the invention and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein:

FIG. 1 is a block diagram of a dialog device according to the invention which is associated with a system of an aircraft;

FIG. 2 represents schematically a keyboard of a dialog device according to the invention;

FIG. 3 shows a set of keyboard keys which are used to control an auxiliary marker; and

FIGS. 4 and 5 show schematically active windows with responsive objects, making it possible to explain the priority control mode which is provided according to this invention.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Referring now to the drawings, wherein like reference numerals designate identical or corresponding parts throughout the several views, the present invention will be described.

The dialog device 1 according to the invention and represented schematically in FIG. 1 is placed on board an aircraft (not shown), preferably a civil transport airplane, and is preferably arranged on the flight deck of the aircraft. This dialog device 1 is intended to allow dialog between at least one operator of the aircraft, in particular a pilot, and a known system, e.g., a flight management system (not shown).

The dialog device 1 is associated with an assembly 2 which includes a computer 3 and multiple screens E1 to E8 which are linked, via links e1 to e8 respectively, to the computer 3.

In the preferred (but not exclusive) embodiment, which is represented in FIG. 1, the assembly 2 is partly divided into two, one part of the system being intended for the pilot, e.g., the left part 4A, and the other part (the right part 4B) being intended for the copilot. With such a distribution, preferably, screens E1 to E3 are intended for the pilot, screens E6 to E8 for the copilot, and screens E4 and E5 are common to both.

Screens E1 to E8, which are of the known Liquid Crystal Display (LCD) type, each include at least one display window F.

Each of the display windows F is a so-called “interactive window,” i.e., a window which includes responsive objects (points, ranges, alphanumeric values, lists, menus, etc.) which can be designated or marked by an object marker main (object) marker M1, auxiliary (object) marker M2, each of the responsive objects OS being associated with a particular function. The appearance of the main marker M1 on a responsive object OS can be caused by controlling a cursor CU which can be displaced by a cursor control device 5. The dialog device 1 includes two identical devices 5, one of which is part of a set of controls 6A of the pilot and the other is part of a set of controls 6B of the copilot. The cursor control devices 5 are linked via links 7 to the computer 3.

Operating one of the devices 5 makes it possible to displace the cursor CU in such a way as to take it onto a responsive object OS to designate it, i.e., to make the main marker M1 appear, as shown in FIG. 5. When a responsive object OS is designated using the cursor CU, it is then marked or highlighted, in particular by a change of appearance such as a change of color or increased brightness. The corresponding change of appearance of the main marker M1 is indicated by a thicker outline of the responsive object OS in FIG. 5. Execution of a function which is associated with a responsive object OS is initiated by confirmation (using a device 5) of the responsive object OS, which has previously been designated by the cursor CU (i.e., it has the main marker M1).

According to the invention, the dialog device 1 includes, additionally, auxiliary control means 8, which are linked by a link 9 to the computer 3, which are arranged so that they can also be actuated by the operator, which are intended to control the auxiliary marker M2 without affecting control of the main marker M1, and which include for this purpose:

at least one actuatable displacement element, as defined below, making it possible to cause a discrete displacement of the auxiliary marker M2, responsive object OS by responsive object OS, on an interactive window F; and

at least one actuatable confirmation element, as defined below, making it possible to confirm a responsive object OS which has the auxiliary marker M2, in such a way as to initiate execution of the function which is associated with the responsive object OS.

In the example which is shown in FIG. 1, each set of controls 6A and 6B includes such auxiliary control means 8.

Thus, when, during execution of a particular function (which has been controlled in the usual way by designating and confirming a responsive object OS using the cursor control device 5 controlling the cursor CU), another function, e.g., an emergency function, must be executed, an operator (the pilot or copilot) who has access to both of the cursor control device 5 and the auxiliary control means 8, can initiate execution of this second function using the auxiliary control means 8, without affecting the function in progress, since the auxiliary object marker M2 which is controlled by them does not affect the control which is carried out using the cursor CU.

Consequently, the second function (e.g., an emergency function) can be executed without having to interrupt the execution in progress of the first function (e.g., a usual function which was planned in advance), the two executions being controlled by the same operator.

Additionally, since the auxiliary marker M2 is subjected to a discrete displacement, it being possible to carry out such a discrete displacement in a precise manner in any situation, in particular while the aircraft is being shaken, execution of an emergency function can, thanks to the invention, be carried out whatever the phase and/or conditions of flight, and in particular when the aircraft is in an area of turbulence.

In a preferred embodiment, the auxiliary control means 8 include keys 11A to 11D, which are shown in FIG. 3 and are part of a separate, specific box (not shown).

Each of the sets of controls 6A, 6B also includes a normal keyboard 10 which is shown in FIG. 2, and includes keys 11 which enable an operator to enter alphanumeric data into the computer 3.

Additionally, in a particular embodiment, the auxiliary control means 8 include keys 11A to 11D, some of which (e.g., keys 11A, 11B and 11C in the example of FIGS. 2 and 3), or even all, are part of the keyboard 10. It is thus unnecessary to provide an independent box to implement this invention, i.e., to form the auxiliary control means 8 which are intended to control the auxiliary marker M2.

In the example shown in FIG. 3:

keys 11A to 11C represent the displacement elements, i.e., they are intended to displace the auxiliary marker M2 on an interactive window F;

key 11D is used to displace the auxiliary marker M2 from one screen to another, preferably cyclically; it can also be used to displace the auxiliary marker M2 from one window F to another window F, in the case that a screen includes more than one window; and

key 11E represents the confirmation element.

According to the invention, on at least some of the windows F, responsive objects OS are available in a suitable form for the keys of the auxiliary control means 8 (whatever they are: keys of a specific box or particular keys 11 of the keyboard 10), and are used for discrete displacement of the auxiliary marker M2 from one responsive object OS to another.

In the example of FIGS. 4 and 5, the responsive objects OS are arranged in columns C1 to C3 and rows L1 to L5, in such a way that the direction arrow keys “←”, “↑”, “↓” and “→” are sufficient to control the displacement of the auxiliary marker M2.

If the responsive objects OS are arranged according to a single direction (row or column), two keys may be enough, e.g. “←” and “→” in the case of arrangement in a row and “↑”0 and “↓” in the case of arrangement in a column, making it easier to control displacement of the auxiliary marker M2.

According to the invention, for each set of controls 6A, 6B, the cursor control device 5 and the auxiliary control means 8 are formed such that control of the main object marker M1 by the cursor control device 5 has priority over control of the auxiliary object marker M2 by the auxiliary control means 8 when the two markers, main and auxiliary, are on the same interactive window F, as can be seen in FIGS. 4 and 5, making it possible to simplify the use of these two control means 5 and 8.

In FIG. 4, the responsive object OS, which is in position C2-L4, has the auxiliary marker M2 (shown by hatching). This responsive object OS can thus be confirmed by the confirmation means 11E of the auxiliary control means 8, and the function which is associated with it can then be executed.

The cursor CU is not in this interactive window F.

When the cursor CU is displaced on this interactive window F, e.g., to designate the responsive object OS at position C2-L4, the main marker M1 appears on this responsive object OS and the auxiliary marker M2 disappears, although it has not been displaced (to illustrate this situation, the (inactive) presence of the auxiliary marker M2 is indicated by hatching with broken dashes).

Additionally, if the cursor CU, and thus the main marker M1, again leave this interactive window F, the auxiliary marker M2 reappears, obviously if it has not been displaced meanwhile, and can then be used to activate the function which is associated with the responsive object OS of this position C2-L4.

According to the invention, the cursor control device 5 is a device which includes, in the usual way, means (not shown), making it possible to:

displace the cursor CU on an interactive window F to designate a responsive object OS;

displace the cursor CU from screen to screen and/or from window to window; and

confirm a responsive object OS, which is designated by a cursor CU in such a way as to initiate execution of the function which is associated with the responsive object OS.

According to the invention, in a first embodiment, the cursor control device 5 is in a form such that it causes, in the usual way, a continuous displacement of the cursor CU on the interactive window F, whereas, in a second embodiment, the cursor control device 5 is in a form such that it causes, also in the usual way, a discrete displacement of the cursor CU on the interactive window F.

In this second embodiment, in a preferred variant, the device 5 for controlling the cursor CU is not a specific device, but is simply formed from some of the keys 11 of the keyboard 10.

In this case, the keyboard 10 can be used simultaneously:

to enter data into the system 1;

to control the main marker M1; and

to control the auxiliary marker M2.

To do this, different combinations of keys 11 of the keyboard 10 are simply used to carry out, respectively, the different tasks.

Additionally, in a third embodiment, each set of controls 6A, 6B includes, as well as the cursor control device 5, another cursor control device 12 which is linked via a link 13 to the computer 3, as shown by broken dashes in FIG. 1, and which also makes it possible to control (designate and confirm) the cursor CU.

In this case, each of the operators (pilot, copilot) has available two devices 5 and 12 to control the cursor CU, so that in the case of a failure of one of his or her control devices 5 and 12, he or she can still use the other control device to initiate execution of functions, which of course increases the reliability of said dialog device 1.

Preferably, one of the devices 5 and 12 is in a form which causes a discrete displacement of the cursor CU, and the other is in a form which causes a continuous displacement of the cursor CU. Since each operator (pilot, copilot) thus has available two control devices 5 and 12, which are complementary but different from each other, he or she can choose whichever is more convenient (either throughout the flight, or temporarily depending on phases and/or conditions of flight), to control the cursor CU, which provides great flexibility of use and increases the comfort of the pilot and copilot in the execution of their tasks. 

1. A dialog method for dialog between an operator of an aircraft and at least one system of the aircraft, comprising the steps of: displaying on a display at least one window including a plurality of responsive objects respectively associated with one of multiple functions of the at least one system of the aircraft; moving a cursor on the display so as to designate a responsive object such that when the cursor is on the responsive object, a main object marker appears and designates the responsive object; and discretely displacing an auxiliary object marker on the display, responsive object by responsive object, so as to designate a responsive object without affecting control of the main object marker.
 2. The dialog method according to claim 1, further comprising: activating a function associated with the responsive object designated by the main object marker; and activating a function associated with the responsive object designated by the auxiliary object marker.
 3. The dialog method according to claim 2, wherein the step of discretely displacing the auxiliary object marker and the step of activating the function associated with the responsive object designated by the auxiliary object marker is performed with keys on a separate stand-alone unit.
 4. The dialog method according to claim 1, wherein the responsive objects are arranged according to at least one direction defined on a corresponding window, and wherein the method further comprises the step of discretely displacing the auxiliary object marker from one responsive object to another responsive object in the at least one direction.
 5. The dialog method according to claim 1, wherein the step of moving the cursor causes the cursor to move in a continuous manner on the display.
 6. The dialog method according to claim 1, wherein the at least one window includes a plurality of windows, and wherein the step of moving the cursor moves the cursor discretely from one window to another window in the plurality of windows.
 7. The dialog method according to claim 1, wherein the display includes a plurality of displays, and wherein the step of moving the cursor moves the cursor from one display to another display in the plurality of displays.
 8. The dialog method according to claim 1, wherein the step of discretely displacing the auxiliary object marker is activated during an emergency mode of the aircraft.
 9. The dialog method according to claim 1, further comprising: removing the auxiliary object marker from the display screen when the main object marker and the auxiliary object marker designate a same responsive object.
 10. A dialog method for dialog between an operator of an aircraft and at least one system of the aircraft, comprising the steps of: displaying on a display at least one window including a plurality of responsive objects respectively associated with one of multiple functions of the at least one system of the aircraft; activating a main object marker appearing on a responsive object so as to initiate execution of a corresponding function of the at least one system; activating an auxiliary object marker appearing on the responsive object so as to initiate execution of another corresponding function of the at least one system without affecting the corresponding function executed by activating the main object marker; and providing a priority of movement on the display screen to the main object marker over the auxiliary object marker when the main object marker and the auxiliary object marker are located on a same window.
 11. The dialog method according to claim 10, further comprising: moving a cursor on the display so as to designate a responsive object such that when the cursor is on the responsive object, the main object marker appears and designates the responsive object; and discretely displacing the auxiliary object marker on the display, responsive object by responsive object, so as to designate a responsive object without affecting control of the main object marker.
 12. The dialog method according to claim 11, further comprising: activating a function associated with the responsive object designated by the main object marker; and activating a function associated with the responsive object designated by the auxiliary object marker.
 13. The dialog method according to claim 12, wherein the step of discretely displacing the auxiliary object marker and the step of activating the function associated with the responsive object designated by the auxiliary object marker is performed with keys on a separate stand-alone unit.
 14. The dialog method according to claim 10, wherein the responsive objects are arranged according to at least one direction defined on a corresponding window, and wherein the method further comprises the step of discretely displacing the auxiliary object marker from one responsive object to another responsive object in the at least one direction.
 15. The dialog method according to claim 10, wherein the step of moving the cursor causes the cursor to move in a continuous manner on the display.
 16. The dialog method according to claim 10, wherein the at least one window includes a plurality of windows, and wherein the step of moving the cursor moves the cursor discretely from one window to another window in the plurality of windows.
 17. The dialog method according to claim 10, wherein the display includes a plurality of displays, and wherein the step of moving the cursor moves the cursor from one display to another display in the plurality of displays.
 18. The dialog method according to claim 10, wherein the step of discretely displacing the auxiliary object marker is activated during an emergency mode of the aircraft.
 19. The dialog method according to claim 10, further comprising: removing the auxiliary object marker from the display screen when the main object marker and the auxiliary object marker designate a same responsive object. 